Journal
Scientific and Technical Journal of Information Technologies, Mechanics and Optics
UDK
Issue:3 (139)
Download PDF0 Kbyte
Methods for audiovisual recognition of people in masks
Annotation
In the modern world, wearing masks, respirators and facial clothes is very popular. The novel coronavirus pandemic that began in 2019 has also significantly increased the applicability of masks in public places. The most affective person recognition methods are identification by face image and voice recording. However, person recognition systems are facing new challenges due to masks covering most of the subject’s face. Existence of new problems for intelligent systems determines the relevance of masked person recognition systems research, therefore the subject of the study is the systems and datasets for masked people recognition. The article discusses analysis of the main approaches to masked people identity recognition: masked face recognition, masked voice recognition and audiovisual methods. In addition, this article includes comparative analysis of images and recordings datasets required for person recognition systems. The results of the study showed that among the methods that use face images the most effective are methods based on convolutional neural networks and the mask area feature extraction. The methods of x-vector analysis showed a slight drop in efficiency which allows us to conclude that they are applicable in the tasks of recognizing the identity of a speaker in a mask. Results of this study help with formulation of requirements for perspective masked person recognition systems and determining directions for further research.
Keywords
Постоянный URL
Articles in current issue
- Methods for audiovisual recognition of people in masks
- Influence of the ratio of the intensities of the reference and object waves on the intensity distribution in the holographic field
- High-precision fiber-optic temperature sensor based on Fabry-Perot interferometer with reflective thin-film multilayer structures
- Optical system design method for the concentration of radiation from a high-power LED
- Detection of potholes on road surfaces using photogrammetry and remote sensing methods
- Adaptive control of nonlinear plant with unmatched parametric uncertainties and input saturation
- Application of failure detection methods to detect information attacks on the control system
- DC motor fault detection and isolation scheme with the use of directional residual set
- Synthesis and implementation of λ-approach of slide control in heat-consumption system
- Photocatalytic properties of Ag-AgBr nanostructures in ion-exchanged layers of bromide sodium-zinc-aluminosilicate glass matrix
- Mechanization of pomset languages in the Coq proof assistant for the specification of weak memory models
- Cloud-based intelligent monitoring system to implement mask violation detection and alert simulation
- Efficient incremental hash chain with probabilistic filter-based method to updateblockchain light nodes
- Method for generating masks on face images and systems for their recognition
- Improving sign language processing via few-shot machine learning
- Quantum-probabilistic SVD: complex-valued factorization of matrix data
- Modelling of basic Indonesian Sign Language translator based on Raspberry Pi technology
- A method of multimodal machine sign language translation for natural human-computer interaction
- Web app for quick evaluation of subjective answers using natural language processing
- Substantiation of construction and evaluation ways of the application efficiency for spatially distributed system of information sensors to provide environment monitoring
- Monitoring of infiltration processes in hydraulic structures using distributed acoustic sensing technology
- Slotted waveguide antenna design for maritime radar system